Papers with stochastic processes
When is a Language Process a Language Model? (2024.findings-acl)
Copied to clipboard
| Challenge: | In some pathological situations, such a stochastic process may "leak" probability mass onto the set of infinite strings. |
| Approach: | They propose to view a language model as a discrete stochastic process X t : t = = t + . |
| Outcome: | The proposed conditions of tightness are generalized to language models and the literature. |